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ABSTRACT 

Let  x(t)  be  a  diffusion  satisfying  the  stochastic  differential 

equation  dx(t)  =  f(x(t))dt  +  db(t) ,  where  f 1 (x)  +  f2(x)  *  ax^  +  bx  +  c, 

a  >  0*  V.  Benes  gave  an  explicit  formula  for  the  conditional  density  of 

x(t)  given  y(s),  0  <  s  <  t,  where  y(s)  *  /Mtsids  +  w(t),  when  w(*)  is 

0 

a  Brownian  process  independent  of  x(#)*  This  result  is  extended  and  then 
applied  to  derive  recursive  filtering  equations  for  estimating  conditional 
moments  Etx11  (t)  |y (s) ,  0  <  s  <  t)  ,  for  estimating  polynomial  functionals  of 
x(*),  and  for  smoothing* 
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SIGNIFICANCE  AND  EXPLANATION 


- >  A  common  problem  in  the  analysis  of  stochastic  systems  is  the  estimation 
of  the  system's  state  given  only  noise- corrupted  or  incomplete  observations* 
For  instance/  examples  occur  in  communications  theory  when  one  wants  to 
estimate  a  signal  sent  over  a  noisy  channel.  The  problem  of  filtering  is  to 
build  an  estimate,  i.e.  filter,  that  provides  the  best  information  about  the 
state  given  the  observations* 

The  most  desirable  solution  to  a  filtering  problem  is  a  recursive# 
physically  realizable  algorithm  that  computes  the  best  mean- square  error 
estimate#  and  thus  it  is  important  to  find  models  for  which  such  algorithms 
exist.  Recently#  BeneS  defined  a  class  of  filtering  problems  that  allow 
explicit  computation  of  the  conditional  density  of  the  signal  given  the  past 
of  the  observations.  This  paper  extends  his  result  and  then  uses  it  to  build 
exact#  recursive  algorithms  for  estimating  any  moment  of  the  signal  and  for 
estimating  polynomial- type  transformations  of  the  signal* 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC#  and  not  with  the  authors  of  this  report. 
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D.  L.  Ocone  ,  J.  S.  Baras  and  S.  I#  Marcus 

1 .  Introduction . 

Let  f(x)  be  a  real-valued  function  defined  on  all  of  R  and  satisfying 
the  Riccati  equation 

f*  (x)  +  f2(x)  «  ax2  +  bx  +  Cm  (1*1) 

It  is  assumed  that  f  has  no  singularities.  Note  that  this  implies  a  >  0, 
for  otherwise  f  explodes  at  some  finite  x.  This  paper  considers  the 
filtering  problem 

dx( t)  =  f(x(t))dt  +  db(t) 

(1.2) 

x(0)  *  x  e  R 

dy(t)  =  x(t)dt  +  dw(t)  (1.3) 

in  which  b(*)  and  w(#)  are  independent  Wiener  processes,  x(*)  is  the 

signal,  and  y(#)  the  observation  of  x(*). 

For  the  system  ( 1 ,1  •)-( 1 .3) ,  Bene§  [1]  recently  derived  an  explicit 

v  v 

formula  for  the  conditional  density  of  x(t)  given  F^,  where  F*  :*  a- 
algebra  generated  by  (y(s) |0  <  s  <  t) •  This  result  is  interesting  because 
the  class  of  functions  satisfying  (1.1)  includes  nonlinear  f,  whereas 
conditional  densities  for  (1.2)- (1.3)  had  been  computed  previously  only  for 
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linear  f:  for  examples  and  an  extension  to  the  multidimensional  case,  see 
BeneS  [ 1 ] « 

Besides  conditional  densities  one  also  wants  to  calculate  filters 

e(<p|F^}  of  x(*)-  dependent  statistics  ^  •  Given  a  random  process  <P(t) 

we  shall  say  that  E(</>(t)|F^}  is  finite  dimensionally  computable  (FDC)  if  it 

can  be  expressed  as  the  output  of  a  finite  dimensional  system  of  stochastic 

differential  equations  driven  by  y ( • ) •  When  the  signal  dynamics  in  (1*2)  are 

linear,  many  examples  of  FDC  estimates  are  known*  For  example,  E(xn(t)|F^} 

is  FDC  for  any  integer  n,  since  the  Kalman-Bucy  equations  calculate 

e(x( t ) |F^  }  and  the  conditional  variance,  and  higher  order  moments  are 

derived  from  these  by  virtue  of  the  normality  of  the  conditional  density*  A 

more  subtle  class  of  examples  consists  of  estimates  E{h(t)|F^}  where  n(t) 

is  any  polynomial  functional  of  x(*)  in  the  form 
s  -  k  k 

net)  =  /*•••  /  n  Y(s ,***,s  )x  (s  )*#*x  n(s  )ds  •••ds,  1  <  i  <  n# 

_  *  i  n  i  n  n 

0  0 

in  which  Y  is  a  separable  function  and  the  {k^}  are  non-negative  integers 
(Marcus,  Willsky  [7];  Marcus,  Mitter,  Ocone  [6])*  Formulae  and  recursive 
systems  for  the  smoothed  estimate  e{x(s)|F^}  are  also  well  known  (see  [3]). 

In  this  note,  we  extend  the  linear  theory  by  showing  that  these  same 
statistics  are  FDC  for  the  general  model  (1*1)-(1.3).  The  strategy,  as  in  the 
linear  case,  is  to  derive  finite  dimensional  systems  by  using  the  explicit 
form  of  the  conditional  density  to  truncate  formally  infinite  dimensional 
systems  of  moment  equations*  The  material  is  organized  as  follows*  In  52  we 

y 

calculate  conditional  joint  densities  of  x( •)  given  F**  As  a  consequence, 
we  show  that  the  conditional  law  of  the  process  (x(s)|0  <  s  <  t)  given  F^ 
and  x(t)  is  Gaussian*  This  is  precisely  the  feature  that  makes  it  possible 
to  handle  polynomial  functionals*  In  §3,  we  prove  FDC  of  conditional  moments, 
smoothers,  and  polynomial  functionals* 


Lie  algebraic  techniques  from  geometric  control  theory  have  been 
introduced  recently  into  filtering,  especially  as  regards  finite  dimensional 
computability,  and  they  have  been  worked  out  successfully  for  known  FDC 
problems  in  which  f  is  linear*  (For  a  survey  of  these  ideas,  see  Brockett 
[8]*)  The  main  results  of  this  paper,  in  particular  proposition  3.7,  were 
suggested  by  a  Lie  algebraic  analysis  of  (1.1)-(1*3).  Consequently,  it  seems 
that  the  full  range  of  the  Lie  theory  for  linear  drifts  extends  to  the  general 
case  (1.1).  Since  our  methods  here  are  not  algebraic,  we  do  not  pursue  the 
issue  further,  but  refer  instead  to  Ocone  [7]  for  further  discussion* 


2*  Conditional  Joint  Penalties* 

Let  x(#)  and  y(*)  be  given  from  (1*1)— (1.3),  and  let  t  -  8Q  >  > 

T 

•••  >  sn  >  0,  z  -  (VV—'Zn>  *  The  exPression  P^g'**2^®^**** 

z  ,s  |Fy)  shall  denote  the  joint  density  of  <x(t),x(s4 ),  •  ••^x(s  ) ) 
n  n  t  in 

conditioned  on  Fy,  that  is,  for  any  bounded,  Borel  ^  i  Rn+  ♦  R 


E{'l»(x(t)/*,,,x(sn))|F^} 


In  Theorem  2*1  of  this  section,  we  employ  a  method  of  Bene9  [1]  to  compute  an 

explicit  formula  for  this  conditional  density*  From  this  we  then  derive 

p(z.,s.;  •••;2  ,s  |F^,x(t))  the  conditional  density  of  (x(81),***»  x(s  )) 

1  l  n  n  t  i  ii 

given  F*  and  x(t). 

The  results  are  stated  in  terras  of  an  auxiliary  process  5(t),  evolving 
in  R  and  defined  by 


where 


d5(t)  =  A(t)5(t)dt  + 


1 

y(t) 

L  o  J 


dB(t) 


A(t) 


5(0)  ■  (x,o,o) 


-1C  0 

0  0 

Ky(t)-V2b  0 


V, 


ic  -  (a+1 )  '2 

and  B( •)  is  a  Brownian  motion  independent  of  the  signal  and  observation 


noises,  b(*)  and  w(*) 


mm.  1 


Let 

s0  -  (5T(t),5T(81),«*‘,«T(sn))T 


s  -  (5t(t)  ,S1(s1),***,51(sn))T 
Then  the  following  conditional  moments  are  needed: 

m(t)  :*  E(C(t) |F^} 

R{t,s)  oov(C(t)  ,£(s)  |F^) 

R(t)  =*  Cr^Ct)]  *-  R(t,t) 

M(t ,s .  #•  •  •  *8  )  :*  E(3|Fp 
in  t 

«  (m.(t) ,***,m,(8  ))T 

i  in 

p0(t's1',**'8n)  !=  Var(20|Ft> 
P(t,s1 ,sn)  :*  Cov(3,H0|F^) 


-  E{(H  -  M)(S0  -  e{S0|F*})T|F*} 


Q(t,8t  ,***,sn)  :=  Var (a |F^)  . 

To  simplify  later  expressions,  we  shall  often  drop  the  (t,s  ) 

dependence  and  write  only  M,  Pq,  P  and  Q.  In  addition,  let 
v  -  (0,1 ,-1 ,0, *  ••  ,0)T  e  R3(n+1).  The  random  vectors  PQv  and  Pv  play  an 
important  role  in  theorem  2*1  and  are  related  by 


Pv 


( (p0v> 1 * <V>4 ' *  * #  ' <P0V) 3n+1 * 


Note  that  (Pv>k  *  (P0V)3k-2  *  °°v  i  (sk-i )  '^2 ( ( t:)  |  F^)  . 


It  is  important  to  observe  that  all  these  conditional  moments  are  properly 
thought  of  as  functionals  (on  C[0,t] )  of  y(*).  Indeed,  these  functionals 


are  easily  calculated  by  solving  for  every  y(*)  e  C(0,t]  the  system 


d£_(s)  *  A_(s)§  (8)ds  + 

y  y  ~y 


"  i  " 

y(s) 

o 

to-  M 


dB(  s) 


5  (0)  -  (x,0 ,0 )  * 


Then,  if  m(t,y(*))  :  E5_(t),  m(t)(u)  »  m(t,y(  •)(«)) ,  and  similary  for  R, 

y 

P0,  etc* 

z 

As  a  final  bit  of  notation,  set  F(zQ)  *  /  f(s)ds. 

0 

Theorem  2.1.  Let  t>s^>s_>##*>s  •  Then 
-  1  2  n 


P(z0't,z1'V*";V8n,^) 


<z0-x) 

(1/'l')exp{p(z0)  +  zQy(t)  +  xx(zQ-x)  +  x[ - - - t]} 


x  exp{-  V2  <£  -  M  +  Pv ,  Q  (z  -  M  +  Pv)>} 

where  V  =  V (t ,s.  ,• *  •  ,s  ,x)  is  a  normalizing  factor. 

1  n 

Proof  ♦  The  demonstration  is  analogous  to  Benes*  proof  in  [1]  of  the  case 
p(Zg,t|F^),  and  so  we  shall  only  sketch  the  main  steps.  The  Kallianpur- 
Striebel  formula  for  conditional  estimation  in  system  (1.2)-(1*3)  implies  that 


P<z0't,*",V8n,F^dV’*dzn 


(2.2) 


*  e{  n  1,  .exp  /ScCsJdyU)  -  \  /fcx2 ( s ) ds> 

j-0  V  0  0 


In  expression  (2.2),  we  think  of  y(t)  as  a  fixed  function  and  of  E  as  an 
expectation  against  the  measure  U  induced  by  (1.2)  on  the  space  of 
continuous  sample  paths  x(#).  here  means  proportional  up  to  a 

normalization  factor  that  does  not  depend  on  z •  To  evaluate  (2.2)  we  follow 
Benes  and  apply  a  sequence  of  Girsanov  measure  transformations.  Let  u 

B ,  x 

denote  the  measure  on  C[0,t]  induced  by  x  +  B(*).  Then  u  <<  u 


and 


d  V 


dU 


( x(  • ) )  *  exp{  J^ftxts^dxfs)  -  Vo  )dsl  • 


B,  X 


By  using  this  to  change  measures  in  the  expectation  term  of  (2*2)  and  noting, 

by  Ito's  rule,  that 

/*  x( s)dy(s)  -  x(t)y(t)  -  ^ytsjdxts) 

0  0 

and 


F( x+B( t ) )  -  F(x) 
we  derive 


/*  f (x+B(s) )dB(a)  -  V2  f*  f  * (x+B(8) )ds, 
0  0 


p ( * • • ) dz  *  exp{P(z0)  -  F(x)  +  2oyt^ 


n 

x  e(  n 

j-0 


^ (x+B ( s  ) edz  }ex^ 


-ftyle)dB[e)  -  V2  j^Vfx+Bfs) )ds) 
0  0 


(2.6) 


5 

where  V(x)  »  (a+t)x  +  bx  +  c.  To  evaluate  this  last  expectation,  we  treat 
the  quadratic  part  of  V  as  arising  from  the  Radon-Nikodym  derivative  of 
x  +  B(*)  with  respect  to  the  Ornstein-Uhlenbeck  process  the  linear 

terms  in  the  exponent  in  (2*6)  can  then  be  re-expressed  in  terms  of  C^f*) 
and  The  result  is 


exp{xk(zQ-x)  +  k[ 


x  e{  n 

jp-0 


(2.7) 


Given  F£,  £(•)  is  a  Gaussian  process 

be  written,  up  to  a  normalizing  factor, 

;  k  .»p<-  Vj  <c  -  a  *  »„». 
RJn<2 


,  and  thus  the  expectation  in  (2.7)  may 
as 

(C  -  E  H  +  p  v)>)exp  Vy  <v,P  v> 
y  0  0  *  0 


-7- 


where  Ey“o  =  and  where  signifies  that  ?1  ■  zQ, 


?4  “  Z1 ' ***'^3n+1 


z  are  held  fixed  and  integration  is  over  the  remaining 
n 


variables.  But  this  last  expression  integrates  by  standard  Gaussian  integral 
formulae  to  a  factor  proportional  to 

exp {-  V2  <z  -  M  +  Pv,  cf 1 (z  -  M  +  P)>}.  (2.8) 

By  combining  (2.6)-(2.8),  we  arrive  at  the  desired  result.  ■ 

The  conditional  density  of  the  process  x( •)  thus  consists  of  a  Gaussian 
factor  multiplied  by  expFfzg).  Further  conditioning  on  x(t)  will  remove 
exp  F(Zq)  and  leave  only  the  normal  part.  Indeed,  let 

s(2)  =  <C1(s1),”*,51(sn))T 


Q(t,s1,***,sn)  = 


n(t) 

°12 

1 

21 

q22 

Q22(t'Sr*’*'Sn)  =  Var<H<2)lFt) 


j 

r4_ ( t)-r . _ ( t) 

m  ( t ) 
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1 

,  M  =■ 

«  <2) 

( 2 ) 

Pv 

M 

_  — 

Corollary  2.9.  The  conditional  law  of  (x(s^ ) ,  •  •  *#x(s  ))  given  F^  and 

in  t 

x(t)  is  normal  with  mean 


1 0 )  (2)  -1 

-  Pv1*'  +  r!i(t)  C21(x(t>  "  mi(t)  + 


and  variance 


Q22~ri1(t)Q21Q12. 


I 


Proof*  Use  (2*1)  to  conclude  that 


P<V91»***»V8nl  x0(t)*  “  P(z0't,”',Zn'Sn|Ft)/p(z0't|Ft) 


exp{-  V2  <z  -  M  +  Pv,Q  (z_-  M  +  Pv)>} 


X  exp{  V2  -y  (zQ  -  m^t)  +  (Pv)^2}). 

But  this  is  just  the  conditional  density  of  n^,***,^  9^ven  where 

)  is  a  normal  random  vector  with  mean  M  -  Pv  and  variance  Q. 

0  n 

The  result  then  follows  from  the  standard  formula  for  conditioning  one  part  of 

a  normal  random  vector  upon  another*  8 

This  corollary  demonstrates  how  closely  those  diffusions  defined  by 

(1.1)- (1.2)  are  related  to  Gaussian  processes*  In  fact,  the  steps  above  can 

be  repeated  to  calculate  joint  densities  of  the  process  x(*)?  (2*1)  yields 

the  correct  expression  if  y(*)  is  replaced  by  0  •  Then,  in  the  same  way, 

it  follows  that  { x{ s4 ) ,  •  • *,x( s  )|x(t))  is  normal,  that  is,  the  process 

l  n 

{x(s)|0  <  s  <  t)  conditioned  on  the  endpoint  x(t)  is  Gaussian.  This 
conditional  normality  is  key  to  the  filtering  results  of  §3. 


1 


3*  Filtering  Equations 


3.1*  Conditional  Moments. 

y\  /s 

Let  x  (t)  :*  E{x(t)|F^}.  x  (t)  satisfies  the  equation 


r  ,  ^  ..  .  .  r  'n+l  , 

dx  *  tn(n-1)/2x  +  nf(x)x  ]  dt  +  [x  -  xx  ]  tdy  -  xdt] 


(3.1) 


(Fujisaki,  Kallianpur,  Kunita  [2]).  To  calculate  x  one  must  therefore  also 
find  xn+\  f(x)xn,  etc.  These  in  turn  also  satisfy  stochastic  differential 
equations  that  introduce  yet  other  quantities  to  be  estimated.  Continuing  in 

A 

this  manner,  if  we  begin  with  x,  we  arrive  at  an  infinite,  coupled  set  of 
conditional  moment  equations  for  x,x  ,»»»,x  ,  •••,f(x)x,  etc.  Our  approach 
to  finite  dimensional  computability  will  be  to  use  conditional  moment 
identities,  derived  from  the  form  of  P(x,t|F^)#  to  truncate  this  infinite 
system  after  a  finite  number  of  terms.  Actually,  FDC  of  the  moments  could  be 
argued  on  general  grounds  using  the  fact  that  the  FDC  process  p( t)  (see 
immediately  below)  characterizes  p(z,t|F*).  However,  the  approach  here  leads 
to  explicit  filtering  equations. 

Straightforward  analysis  of  (2.1)  shows  that 


p(x,t|F*)  *  gfc")  exp  {F(  z)  -  (z-y(t))2/2a(t)  } 


where  N(t,x)  is  a  normalizing  factor,  and 

a  *  1  -  k2  d2  o(0)  -  0 
dp  -  [-<2  op  -*/£ba]dt  +  ody  p(0)  -  x 
(See  BeneS  [1].)  Note  that  (3.2)  implies  that  1  -  <2o2(t)  >  0 
and  hence  that 

a  <  a*1  (t)  v  t  >  0. 


(3.2) 

(3.3) 


10- 


As  a  consequence,  xn(t)  is  well-defined  for  any  n  •  If  a  >  0,  (1*1) 


1  72 

implies  f(x)  ^a  2x  as  |x|  ♦  •  and  thus  that  F(z)  ^  ~~  z  as 


|z|  -►  «.  Therefore 


F(  z)  -  (z  -  y)  /2o  -  V2  (a  /2  -  a  )z  ,  |z| 


V2  _  -1»_2 


and  so  P(z,t|F^)  decays  as  expt“&2],  5  ■  (o  ^  -  a  ^  )  >  0.  If  a  *  0, 
then  b  »  0,  c  >  0  is  necessary  in  order  that  (1*1)  have  a  solution  f  on 
R  without  singularities.  Then  f  will  be  bounded, and  F(  z)  will  grow  at 
most  linearly. 

Lemma  3.4.  For  n  >  0 

,  -1  >/n+2  ..  ^  ,  -2  ^rvM  .  ...  . .  2  -l/il 

(a  -  a)x  -  (b  +  2 pc  )x  +  (c  +  ((2n+1)  -  y  )a  )x 

_  -1*^1  ,  n-2 

+  2yna  x  -  n(n-1)x  . 


Proof .  Integrating  by  parts,  we  have 


2 

— — -  /"d z  expF(  z)  — -fz11  exp [-(z  -  y)  /2c]) 

lt'x)  «.  dz 


/"dztf'(z)  +  f2(z)Jznp(z,t|Fj) 


^nf2 

ax  +  bx  +  cx  • 


-2 

d  r  n 


Evaluation  of  (zn  exp[-(z  -  y)2/2o])  in  the  first  integral  leads  to  the 


desired  identity. 
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I 


Proposition  3% St  x  (t)  is  FDC  for  all  n  • 


Proof:  Since  o  (t)  -  a  >  0  ,  lemma  3*1  implies  that  x  (t),  m  >  2  can  be 
expressed  as  a  linear  combination  with  FDC  coefficients  of  lower  order 
conditional  moments*  Thus  it  suffices  to  prove  that  x(t)  is  FDC.  For 

A 

x(  t)  t  (3.1)  becomes 

dx  ■  f(x)dt  +  (x^  -  x2)(dy  -  xdt) ,  x(0)  ■  x  . 


tlx)  -  /  dz[d/dz  expF(z)]exp[-(z  -  y)2/2o] 

t|X) 


-  /  dz( z  -  u)  0  p(zft|F^) 


-(x  -  \l)(3 


x^  =*  [x(b  +  2 \ia  2)  +  c  4-  (1  -  \?)o  (a  1  -  a)  \ 


A  A  -1 
dx  3  ( p  -  x)  o  dt 

♦  [(x(b  +  2yo  2)  +  c  +  (1  -  y2)a1)(o^  "-a)  *  -  x2]  [dy  -  xdt] 

A 

together  with  (3.2)-(3.3)  constitutes  a  finite-dimensional  system  for  x(t) 


Remark.  It  is  also  clear  that  f(x(t))x  (t)  will  be  FDC  for  any  n;  simply 
eliminate  f(x(t))  in  favor  of  polynomials  in  x(t)  by  integration  by  parts 
as  in  the  proof  above.  In  the  same  way#  filters  may  be  constructed  for 
any  conditional  estimate  in  the  infinite  set  of  moment  equations  generated  by 

A 

starting  with  x(t)  and  using  (3.1). 
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3.2.  Smoothing* 

Proposition  3*6*  Let  s  <  t*  Then 


E{x(8)iFyj 


sinhxg 

sinh<t 


fx(t) 


xe  Kt  +  (P(t,s)v)^]  +  xe  <B  -(P(t,s)v)2* 


Proof :  This  is  immediately  consequent  from  corollary  2*9  once  it  is  noted 


that 


r1^(t)021  *  r^tjcov^t),^)) 


sinhxg 

sinhxt 


and 


m^(t)  *  xe  • 

Explicit  formulae  for  (P(t#s)v)1  and  (P(t,s)v)2  are  easily  found  and  will 
be  given  in  the  next  section. 


3.3.  Polynomial  Functionals* 

Let  H(t)  be  any  non-anticipating  functional  of  the  signal  process  of 
the  form 

s  k  k 

h(t)  »  j  •  •  •  /n  Y(s«,##*,s  )x  (s,)**#xn(s  )ds  •••ds< 

0  0  Ini  n  n  1 

where  kw***,k  are  arbitrary,  non-negative  integers  and  Y(s«,***,s  )  is  a 
in  in 

a 

separable  function.  Also  let  h(t)  -  E{h(t)|F^}. 

Proposition  3*7,  0(t)  is  FDC 

For  simplicity  we  restrict  attention  to  the  case 

k(#»k^**##*k  -1;  the  method  of  proof  extends  easily  to  general 

I  2  n 

choices  for  the  k^'s*  Our  proof  relies  on  the  following  identity,  presented 
here  in  the  form  that  it  appears  in  Marcus  and  Willsky  (7]. 
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Lemma  3*8*  Let  (u4,**#,u  )  be  a  normal  random  vector  with  e4  -  Eu4  and 
—  1  m  j  j 


Viji*  cov(ui#UjJ.  Then 


m 

rMlu  1  »  1  e  +  I  V  e  •••e  +  I  v  V  e  •  •  *e  +••• 

1  *  1  *  V2  j1j2  *3Os  \ 


The  sums  are  taken  over  all  possible  combinations  of  pairs  of  indices* 


Lemma  3.9,  Let  s-  >  •••  >  s  •  Then 
-  1  n 


n 

e(x(s  )«"x(s  )|F*  x(t>)  -  I  nt)a,(t,8w,M,s  J 
1  n  t  j-0  jin 


for  some  separable  functions  a^(t,s1 ,  ••*,sn),  0  <  j  <  n  ,  depending  on 


(2)  (2)  -1 

Pr°of  1  Let  “  Mj  -  PVj  +  r^lt)  Q12(t,  ***,8^  [x(t)  -m^t)  +  (Pv^I 


0  *  Q22  "  r11(t)  ®12C21 
and  apply  lemma  3.8  and  corollary  2*9.  Thus 


e(x(s  )***x(s  )|x<t),F^}  -  l  •••*  +  l  Q  l  •••£ 
1  n  tin  j2  j3 


+  H  Oj  j  o i  j  +  •••  • 

3132  3J34  35  3n 


This  is  an  nc  order  polynomial  in  x(t)  since  is  a  linear  function 

of  x(t)  for  each  j  *  Moreover,  it  is  clear  that  the  coefficients  *j  will 
be  separable  if  PQ(t,s1 , • • *»sn)  and  hence  Q(t,s1 ,  •  •  *,*n)  are  separable  (Q 
is  a  submatrix  of  Pg).  But 


'I 

t 


P„(t,S, f • • •# 8  ) 
u  i  n 


R(t,t) 

R(t,s1>  ••• 

R(t,s  ) 
n 

R(s1#t) 

R(s1,s^)  ••• 

RC,i'V 

• 

R(s  ,t) 
n 

•  •  • 

R(s  ,8  ) 
n  n 

and  R(t,s)  »  t,  s)R(  a,  a)  ■  $A(  t,0 )  l  8,0  )R(  s)  where  t^tt/s)  is  the 

state  transition  matrix  of  A( t) .  Thus  P ( t, •  •  *,s  )  is  indeed  separable. 

0  n 

Remarks  Upon  further  inspection  of  the  terms  4^(tfs)  and  R(s),  the  proof 
of  this  lemma  demonstrates  that  aj  may  be  written 


i.(t,sw  •••/a  )  -  l  ft  . (t)  8*  _(s  _(•  ) 

j  1  n  i  J'1  j*2  1  J'n  n 


(3.10) 


where  each  g  .  #  0  <  k  <  n  is  either  deterministic  or  a  non- ar*ticipa  ting 

j  i* 

functional  of  the  observation  process  y(  •  )• 

Proof  of  propositions  By  using  lemma  3e9 
E{n(t)  IF*} 


f  •••/**"  Y.(s1>  •••Yn(sn)Bfclx(s1)  •••x(sn)  |F^,x(t)]  |  F^}dsn»‘«ds1 
0  0 


n  s 

7  xJ(t)  y  f  n  y(8  , •••,s  )a  (t#s  ,  •••,s  )ds  •••ds<  • 
j»0  00  ■  n  J  1  nn  l 


TO  complete  the  proof ,  it  is  only  necessary  to  show  that  the  coefficients  of 
*  i 

x  (t)  are  FDC«  Each  coefficient  is  a  sum  of  terms  of  the  form 

s 

U  .a(t)  -  cl.  ( t )  j  •••  JnoL(a, )•••<*  (s  )ds  •••ds 
n+ 1  ^0  q  I  1  nnn  i 

which  can  be  computed  on-line  by  the  system 
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u,(t)  -  a  (t) 

i  n 


u2(t)  -  •„_,(»)«,<« 


u^O)  -  0 


u2(0)  -  0 


u  (t)  -  a  (t)u  (t) 
n  in 


u  (O)  -  O 
n 


Vl(t)  "  °Olt)un(t) 


Un+1(0) 


0  . 


Thus 


un+i(t)  will  be  FDC  if  each  a^(t)  is  FDC.  However,  reasoning  from 


the  remark  after  lemma  3.9,  each  a^(t)  will  be  either  deterministic,  or  a 
deterministic  function  multiplied  by  one  of  the  y( *)-dependent  0*  (t)  from 

J  i* 

(3.10).  Now  by  the  proof  of  lemma  3.9  these  0*  (t)  come  from  the 

j 

y( •) -dependent  terms  in  l^t  1  <  i  <  n,  and  Q.  Actually,  inspection 


reveals  that 


1) 


Q  is  independent  of  y<*),  since  it  is  a  function  of  the 

2 ) 

joint  covariance  C  (t) , •••,5^ (sft) j  and  ;  the  only  y-dependence  in  the 
lies  in  Pv.  Recall  from  §2,  that  a  typical  element  of  Pv  is 
cov(€j(s) ,  ?2^t)  "  ?3< t ) ) ;  a  simple  calculation  shows  this  equals 


cov(C1<s) ,C2(s)  -  £3(8) )  -  <  sinhKs  j^e  *Ug(u)du 


(3.11) 


-  <  ^sinhJCs  f8 e  *Ug(u)du 
0 


where  g(u)  *  <y(u)  -  V2  *>•  The  y(  •)  functionals  in  this  expression  are 

certainly  FDC  and  thus  the  components  0*  .  (t)  are  FDC.  This  completes  the 

j 

proof . 


The  proof  of  proposition  3.7  is  similar  to  the  proof  of  the  linear  case 
due  to  Marcus  and  Willsky  (7]  in  its  use  of  Gaussian  moment  identities. 
Actually,  because  conditional  Gaussianity  obtains  in  the  linear  case  without 
first  conditioning  on  x(t),  Marcus  and  Willsky  are  able  to  use  the  general 
filtering  equation  and  a  simpler  moment  identity  than  lemma  3.8  to  build  a 
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proof  by  induction  on  the  order  of  H(t).  By  1 general  filtering  equation1  is 
meant  the  representation  of  Fujisaki,  Kallianpur,  Kunita  [2] s 


*  k  s  k  k 

an  -  e(x  1(t)  /*•••  /  n'2Y(t,»*)x  2 ( s * ) * • *x  "(s  ,)as  •••as  |F^}at 
i  ^  i  n-i  n- l  l  r 

0  0 


(3.12) 


+  [n(t)x(t)  -  n(t)x(t))[dy(t)  -  x(t)dt) 


In  our  proof,  application  of  (3.12)  is  superfluous,  although,  when  calculating 
the  filter  in  a  particular  example,  it  can  be  employed  to  advantage.  The 
example  below  will  illustrate  the  possibilities. 

Marcus,  et  al  [6]  give  an  alternate  proof  of  finite  dimensional 
computability  when  f  is  linear  by  using  homogeneous  chaos  theory  and 
multiple  integral  expansions.  Such  an  approach  might  also  be  possible  here  by 
first  conditioning  on  x(t),  but  this  is  not  pursued,  since  the  calculation 
would  ultimately  be  like  the  one  here. 


Example.  Consider  the  model 


dx(t) 

-  f(x(t))dt  +  db( t) 

x(0) 

dn(t) 

*  x2(t)dt 

n(0) 

dy(t) 

»  x(t)dt  +  dw(t) 

y(0) 

where  the  x(*)  and  y(#)  equations  are  as  in  (1-1)— (1.2)*  We  will  present 

a  finite  dimensional  system  for  computing  n(t)  *  e(  /tx2( s)ds|F^K  This 

0 

problem  was  chosen  in  part  by  way  of  comparison  to  the  special  case  f  =  0 
which  is  treated  in  detail  in  Liu  and  Marcus  [4] •  The  system  given  here  for 

A 

T)( t )  is,  of  course,  one  among  many  possibilities;  our  construction  was 
guided  by  the  decision  to  use  Ito  equations  driven  by  the  innovations 

A 

dV(t)  dy(  t)  -  x(t)dt. 
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u(t)  »  (sinhKt)"2  P  (8inh<s)2dg  -  ( sinhict)"1  [ (4K)"1sinh2iet  -  V2  t] . 
0 


Then 


cm  =  x  dt  +  u(t)[x  -  x  x]dv 

+  2[?-  X2]  [tt(t)(v2(t)K'1tlnhiet  +  (oy(t)  -  H)) 

+  v^tjsinhict  -  (<sinh<t)  v3(t)]dv 


n(0) 


dv1  =  sinhict  (U  -  Oy(t))  dt 


dv2  »  e  [<y(t) 


dv^  *  (sinhict)  v2(t)dt 


v1 (0)  =  0 


v2(0)  =■  0 


v3(0)  ■  0. 


)  (3.13) 


(3.13)  is  not  the  complete  system,  since  equations  for  M,o,x,x  ,  and  x  are 
also  needed.  However  these  are  easily  garnered  from  $3.  A  brief  derivation 


of  (3.13)  follows.  Prom  (3.12) 


*  ^  /\ 
dh  *  x  dt  +  (hx  -  Hx)dV. 


(3.14) 


However,  corollary  2.9  implies 


e(x2(s)|F *,x(t)>  -  Q22  -  r"J(t)e21ff12  +  E2{x(s)|F*,x(t)> 
-  F(t,s)  +  r”2(t)Q2^  x2(t) 

+  2x(t)r*](t)ft21(m1(s)  -  (Pv)2  -  r"](t)Q21(m1(t)  -  Pv^] 


(3.15) 


where  F(t#s)  combines  those  terms  not  depending  on  x(t).  How 


sinh<s/sinh»ct# 


ri1(t)Q21 


and 


*  PVj(s)  -  <  1sinh<8  [/%  <Ug(u)du  -  /8e  *Ug(u)du] 


(Recall  that  g(u)  =  *cy(u)  -  1/2  b.)  Further,  it  can  be  shown 
n>1  ( t)  -  Pv^t)  -  (W  -  Oy)(t). 

Using  these  identities  in  (3*15)  it  follows  that 


hx  -  hx  *  /^{(xtt)  -  x(  t)  )e{x2(s)  |F^,x(t)}  |F^}ds 


A  A  /\  * 

(x3  -  x2x)u(t)  +  2 (x  -  x  )u(t)[(0y  -  +  *  sinh<t  j^e  <Ug(u)du 


+  2(x2  -  x2)[(sinhKt)  1  /t (sinh<s) (s)  -  Pv^tsJlds 


-1  f 
0 


-  (<8inh<t)  1  /^(sinh^s)2  /8e  <Ug(u)duds]* 
0  0 


(0  -C2x)u(t)  +  2(x2  -  x2)tu(t)(v2(t)K“1ainhKt  +  Oy(t)-U) ) 

+  v^ftJainhK  +  «(<ainh»ct)”1v3(t)] 


(3.16) 


Placing  (3.16)  in  (3.14)  one  obtains  the  desired  result. 
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